Fusion of Thermal Infrared and Visible Images Based on Multi-scale Transform and Sparse Representation
نویسندگان
چکیده مقاله:
Due to the differences between the visible and thermal infrared images, combination of these two types of images is essential for better understanding the characteristics of targets and the environment. Thermal infrared images have most importance to distinguish targets from the background based on the radiation differences, which work well in all-weather and day/night conditions also in land surface temperature (LST) calculation. However, their spatial resolution is relatively low, making it challenging to detect targets. Image fusion is an efficient method that is employed to enhance spatial resolution of the thermal bands through fusing these images with high spatial resolution visible images. Therefore, it is desirable to fuse these two types of images, which can combine the advantages of both the thermal radiation information and detailed spatial information. Multi-scale transforms (MST) and sparse representation (SR) are widely used in image fusion. To improve the performance of image fusion, these two types of methods can be combined. In this regard, an MST is firstly performed on each of the preregistered source images to obtain their low-pass and high-pass coefficients. Then, the low-pass images are combined with a SR-based fusion approach while the high-pass images are fused using the absolute values of the coefficients. The fused image is finally obtained by performing an inverse MST on the merged coefficients. In this paper, nine image fusion methods based on the multi-scale transform and sparse representation, namely Laplacian pyramid (LP), ratio of low-pass pyramid (RP), wavelet transform (Wavelet), dual-tree complex wavelet transform (DTCWT), curvelet transform (CVT), nonsubsampled contourlet transform (NSCT), sparse representation (SR), hybrid sparse representation and Laplacian pyramid methods (LP-SR) and hybrid sparse representation and NSCT methods (NSCT-SR) are tested on FLIR and landsat-8 thermal infrared and visible images. To evaluate the performance of different image fusion methods we use three quantitative evaluation metrics: entropy (EN), mutual information (MI), and gradient based fusion metric )QAB/F(. Despite the lack of spectral coverage between the visible and thermal infrared bands of Landsat 8, quantitative evaluation metrics showed that the hybrid LP-SR method provides the best result (EN=7.362, MI=2.605, QAB/F =0.531) and fused images have best visual quality. This method improve spatial details while preserving the thermal radiation information. It followed by RP, LP, and NSCT methods. Similar results were achieved in FLIR images.
منابع مشابه
Modeling the potential of Sand and Dust Storm sources formation using time series of remote sensing data, fuzzy logic and artificial neural network (A Case study of Euphrates basin)
Due to the differences between the visible and thermal infrared images, the combination of these two types of images leads to better understanding of the characteristics of targets and the environment. Thermal infrared images are really in distinguishing targets from the background based on the radiation differences and land surface temperature (LST) calculation. However, their spatial resolu...
متن کاملInfrared and visible image fusion technology based on directionlets transform
The article provides an infrared and visible image fusion algorithm based on directionlets transform. The registered original images were decomposed into the low-frequency and high-frequency coefficients by directionlets transform. Getting the mean of the low-frequency coefficients, applying the local variance maximum principle to the high-frequency coefficients, thereby the fusion coefficients...
متن کاملDirect Fusion of Geostationary Meteorological Satellite Visible and Infrared Images Based on Thermal Physical Properties
This study investigated a novel method of fusing visible (VIS) and infrared (IR) images with the major objective of obtaining higher-resolution IR images. Most existing image fusion methods focus only on visual performance and many fail to consider the thermal physical properties of the IR images, leading to spectral distortion in the fused image. In this study, we use the IR thermal physical p...
متن کاملFusion of Multi-Scale Visible and Thermal Images using EMD for Improved Face Recognition
This paper presents the implementation of face recognition system using JDL framework. Fusion of visible and thermal images enhances the recognition rate and efficiency under varying illumination conditions. In this system, registration of visible and thermal images is performed using Fourier based method and fusion is performed using Empirical Mode Decomposition (EMD). The feature extraction a...
متن کاملFace Recognition in Thermal Images based on Sparse Classifier
Despite recent advances in face recognition systems, they suffer from serious problems because of the extensive types of changes in human face (changes like light, glasses, head tilt, different emotional modes). Each one of these factors can significantly reduce the face recognition accuracy. Several methods have been proposed by researchers to overcome these problems. Nonetheless, in recent ye...
متن کاملمنابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ذخیره در منابع من قبلا به منابع من ذحیره شده{@ msg_add @}
عنوان ژورنال
دوره 8 شماره None
صفحات 39- 59
تاریخ انتشار 2020-12
با دنبال کردن یک ژورنال هنگامی که شماره جدید این ژورنال منتشر می شود به شما از طریق ایمیل اطلاع داده می شود.
کلمات کلیدی برای این مقاله ارائه نشده است
میزبانی شده توسط پلتفرم ابری doprax.com
copyright © 2015-2023